# 7B lightweight

This is a 7B parameter model based on the Mistral architecture, optimized through quantization, offering various GGUF quantization versions to meet different hardware requirements.

This model is an ORPO fine-tuned version based on Mistral-7B-v0.3, integrating supervised fine-tuning and preference alignment stages, suitable for chat and text generation tasks.

Noro-Hermes-3x7B is a Mixture of Experts (MoE) model built using the lazy merge toolkit, combining three 7B-parameter Mistral variant models with capabilities in intelligent assistance, creative role-playing, and general task processing.

Nous Hermes 2 is a next-generation flagship 7B Hermes model based on Mistral 7B DPO, optimized with DPO and demonstrating excellent performance across multiple benchmarks.

CatPPT is a high-performance 7B chat model that fuses the openchat and neuralchat models through the Gradient SLERP method. It performs excellently on the leaderboard and has no evaluation data pollution.